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Executive Summary 



A number of National Center for Education Statistics (NCES) surveys can be used 
to estimate enrollment levels in postsecondary education. Generating consistent enroll- 
ment estimates across surveys, however, is complicated by differences in surveys that 
lead to different enrollment counts. This Research and Development (R&D) report de- 
scribes the process of generating comparable estimates of undergraduate enrollment in 
postsecondary institutions across four NCES datasets — the National Postsecondary Stu- 
dent Aid Study (NPSAS), a sample survey of postsecondary students; the Integrated 
Postsecondary Education Data System (IPEDS), a universe survey of postsecondary insti- 
tutions; the National Household Education Surveys Program (NHES) Adult Education 
Survey, a sample survey of adults in households; and the October school enrollment sup- 
plement to the Current Population Survey (CPS), a sample survey of adults in house- 
holds. The purpose of the report is to highlight differences across surveys that may affect 
postsecondary enrollment estimates and to describe how largely comparable estimates 
can be derived, given these differences. 

For each dataset, the analysis estimated the number of individuals enrolled in post- 
secondary education in the 1989-90, 1995-96, and 1999-2000 school years, or the clos- 
est available time period to those dates. Enrollment counts were estimated for the tradi- 
tional college age group, ages 18 to 24, as well as for those individuals ages 18 to 64. 
Each estimate was placed over the relevant population age group to obtain an estimate of 
the percentage of the population enrolled in postsecondary education, using resident 
population counts (for April 1990, 1996, and 2000) provided by the U.S. Census Bureau. 

Preliminary estimates for undergraduate and graduate students combined, with 
minimal corrections for survey differences, revealed inconsistencies in enrollment levels 
within years and in trends across years from one survey to another. Survey differences 
that may contribute to these inconsistencies include the following: 

• Sources of information: Whether a student, postsecondary institution, or house- 
hold member provided enrollment information, and whether proxy respondents 
are allowed. For example, CPS and NHES collect information from household 
members, NPSAS collects information from students, and IPEDS collects infor- 
mation from postsecondary institutions. In CPS surveys, an adult member of each 
household serves as a proxy respondent, providing information for all members of 
the household. 

• Reference period: Whether the survey asked about enrollment at one point in time 
or over an entire school year or calendar year. For example, while NHES collects 
full-year enrollments, CPS collects fall-only enrollments. 

• Definition of enrollment: Differences in the types of enrollment counted in the 
survey, such as whether students had to be in for-credit courses (e.g., NPSAS) or 
courses leading to a degree (e.g., NHES). Also, differences in the target popula- 
tion (e.g., whether military personnel are included in the population). 

• Definition of postsecondary institution: Which postsecondary institutions were in- 
cluded in the survey and how eligible institutions were defined. Some surveys set 
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specific criteria in defining postsecondary institutions (e.g., IPEDS), whereas oth- 
ers rely primarily on respondent perception (e.g., CPS). 

• Variations in survey administration: These differences are assumed to be largely 
corrected by sample weights, and include factors such as telephone -based sam- 
pling, time of year of administration, and differences in response rates. 

The remainder of the report focuses on undergraduate enrollments only. The follow- 
ing adjustments were made to the datasets to obtain undergraduate enrollment estimates 
that are as comparable as possible. 

NPSAS. To make NPSAS estimates comparable across time, the three waves of 
NPSAS data were restricted to Title IV eligible institutions (i.e., institutions eligible to 
participate in the federal student financial aid program) and excluded institutions in 
Puerto Rico. Because of inconsistencies in the inclusion of students in less-than-2-year 
institutions in the IPEDS and CPS datasets, students enrolled in less-than-2-year institu- 
tions were excluded as well. In cases where student age was missing, these data were 
imputed. 

IPEDS. Because IPEDS generally does not collect enrollment by age categories 
from less-than-2-year institutions, these schools were excluded from the analysis, as were 
institutions in areas other than the 50 states and the District of Columbia. IPEDS provides 
both full-year and fall-only enrollment counts; however, because IPEDS full-year en- 
rollment data are not disaggregated by age, this analysis used IPEDS fall-only enroll- 
ments. Age was imputed when missing. 

NHES. The 1991 administration ofNHES was not used to examine undergraduate 
enrollments because in the 1991 survey these enrollments could not be separated from 
graduate enrollments. In the remaining years, data were restricted to adults working on 
either an associate’s or a bachelor’s degree; cases in which adults indicated they were 
working on “another degree” were individually examined and recoded into these degree 
categories as necessary. 

CPS. CPS includes separate questions about enrollments at a “regular” school and 
enrollments in “business, vocational, technical, secretarial, trade, or correspondence 
courses.” Because the second question potentially includes a wide range of courses out- 
side of postsecondary education, only responses to the first question were used in this 
analysis, effectively restricting the estimates to those enrolled in 2- or 4-year institutions. 
No other adjustments were made to the CPS estimates. 

After making these adjustments, levels of enrollment were generally not signifi- 
cantly different for those surveys with similar reference periods (i.e., full-year NPSAS 
and NHES vs. fall-only IPEDS and CPS). As one would expect, full-year enrollments 
were often higher than fall-only enrollments. The remaining differences across surveys 
can be reasonably attributed to factors such as the population surveyed, the survey meth- 
odology, and the time of year in which the survey was administered. 
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Because of the potential effects of survey differences on postsecondary enrollment 
estimates, it is important that the analyst examining participation in postsecondary educa- 
tion note the reference period, levels of degrees, and institution types covered by the 
analysis, and the effects of this coverage related to other possible analyses and/or data 
sources. Which data sources to use, and which adjustments to make, will depend in large 
part on the questions the analyst wishes to answer. 
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Foreword 



The Research and Development (R&D) series of reports at NCES has been initiated to 

1 . Share studies and research that are developmental in nature. The results of such 
studies may be revised as the work continues and additional data become 
available. 

2. Share the results of studies that are, to some extent, on the “cutting edge” of 
methodological developments. Emerging analytical approaches and new computer 
software development often pennit new and sometimes controversial analyses to 
be done. By participating in “frontier research,” we hope to contribute to the reso- 
lution of issues and improved analysis. 

3. Participate in discussions of emerging issues of interest to educational research- 
ers, statisticians, and the federal statistical community in general. Such reports 
may document workshops and symposia sponsored by NCES that address meth- 
odological and analytical issues or may share and discuss issues regarding NCES 
practices, procedures, and standards. 

The common theme in all three goals is that these reports present results or discus- 
sions that do not reach definitive conclusions at this point in time, either because the data 
are tentative, the methodology is new and developing, or the topic is one on which there 
are divergent views. Therefore, the techniques and inferences made from the data are ten- 
tative and subject to revision. To facilitate the process of closure on the issues, we invite 
comment, criticism, and alternatives to what we have done. Such responses should be di- 
rected to 

Marilyn Seastrom 

Chief Statistician 

Statistical Standards Program 

National Center for Education Statistics 

1990 K Street NW 

Washington, DC 20006-5651 
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Introduction 



A number of National Center for Education Statistics (NCES) surveys can be used 
to estimate enrollment levels in postsecondary education. Generating consistent enroll- 
ment estimates across surveys, however, is complicated by differences in surveys that 
affect enrollment counts — for example, there are different definitions of “postsecondary 
institution” and differences in whether enrollment is estimated for a specific point in time 
or across the entire year. Given these differences, estimating participation in postsecond- 
ary education can be deceptively difficult, and analysts should consider a number of is- 
sues when making or interpreting such estimates, particularly when comparing estimates 
derived from different surveys. The purpose of this Research and Development (R&D) 
report is to highlight differences across surveys that may affect postsecondary enrollment 
estimates and to describe how largely comparable estimates can be derived, given these 
differences. 

In this context, the survey estimates themselves are merely illustrative of the results 
that are likely under different “adjustment” scenarios, and the analyses focus on compari- 
sons of estimates rather than on the values of the estimates themselves. Also, in this re- 
port, consistent results refers to consistent test results (e.g., all tests find a significant dif- 
ference in the same direction) and should not be interpreted as indicating that estimates 
have been found to be equivalent. No tests of equivalence were perfonned. Given these 
caveats, the enrollment rate estimates presented in this report should be viewed only as 
tentative and should not be used without further testing to reach firm conclusions about 
postsecondary enrollment levels or trends. 

Datasets 

Four datasets were analyzed for this report: the National Postsecondary Student Aid 
Study (NPSAS), the Integrated Postsecondary Education Data System (IPEDS), the Na- 
tional Household Education Survey (NHES), and the October school enrollment supplement 
to the Current Population Survey (CPS). 1 These datasets were chosen because they are 
based on nationally representative samples of postsecondary students or adults (or a cen- 
sus of institutions in the case of IPEDS), collect enrollment data by age, and are available 
for at least three time points between 1989 and 1999. Each is described briefly below; the 
appendix provides additional details on each survey’s methodology. 

National Postsecondary Student Aid Study 

NPSAS is a nationwide study conducted by NCES that is designed to detennine how 
students and their families pay for postsecondary education, and to describe demographic 
and other characteristics of those enrolled in postsecondary education. The study is based 
on a nationally representative sample of students in postsecondary education institutions, 
including undergraduate, graduate, and first-professional students. Students attending all 
types and levels of institutions are represented, including public and private not-for-profit 



1 Although the Bureau of the Census conducts the CPS for the Bureau of Labor Statistics, NCES funds the October 
enrollment supplement and it is therefore referred to as an NCES survey in this report. 
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and for-profit institutions, less-than-2-year institutions, community colleges, and 4-year 
colleges and universities. NPSAS data come from multiple sources, including institu- 
tional records, government databases, and student telephone interviews. Detailed data 
concerning participation in student financial aid programs are extracted from institutional 
records. Data pertaining to family circumstances, background demographic data, and 
educational and work experiences and expectations were collected from students using a 
computer-assisted telephone interview. The first NPSAS study was conducted during the 
1986-87 school year (NPSAS: 87); subsequent studies have been carried out during the 
school years 1989-90 (NPSAS:90), 1992-93 (NPSAS:93), 1995-96 (NPSAS:96), and 
1999-2000 (NPSAS :2000). The sample sizes of the five NPSAS studies range from ap- 
proximately 45,000 students in 975 institutions to 65,000 students in 1,100 institutions. 

Integrated Postsecondary Education Data System 

IPEDS is a comprehensive data collection system designed to encompass all institu- 
tions and organizations whose primary purpose is to provide postsecondary education. 

The IPEDS system is built around a series of interrelated surveys that collect institution- 
level data in such areas as enrollments, program completions, faculty, staff, and finances. 
The Fall Enrollment (EF) Survey in IPEDS is conducted annually and collects data on the 
number of students enrolled for credit in postsecondary institutions in the United States and 
its outlying areas in the fall of a given year. For the time period covered in this report 
(1989-90 to 1999-2000), enrollment counts by age categories were collected in odd years 
and generally only from institutions offering an associate’s degree or higher. Unlike the 
other data sources, which are based on samples, IPEDS is considered a census of postsec- 
ondary institutions and is therefore not subject to sampling error. 2 

National Household Education Survey 

NHES is a system of telephone surveys of the civilian noninstitutionalized popula- 
tion of the United States. Of interest for this report are the NHES Adult Education sur- 
veys conducted in 1991, 1995, and 1999 (NHES: 1991, NHES: 1995, and NHES: 1999). 
The Adult Education surveys ask persons 16 years of age and older who were not en- 
rolled in elementary or secondary school at the time of the interview about their participa- 
tion in basic skills courses, English as a Second Language (ESL) courses, credential 
(postsecondary degree or diploma) programs, apprenticeships, work-related courses, and 
personal development/interest courses over the previous year (typically spring to spring). 
Adults participating in programs or courses provide information about those activities, 
including the activity’s subject matter, duration, cost, location and sponsorship. The sam- 
ple sizes for the Adult Education survey range from approximately 6,700 to 19,700 re- 
spondents age 16 or older (age 17 or older in 1991). When appropriately weighted, the 
NHES Adult Education Survey samples are nationally representative of all civilian, non- 
institutionalized adults (i.e., excluding military personnel and their families living on post 
and residents of institutions such as prisons) in the 50 states and the District of Columbia. 



2 As discussed in the section “Definition of Postsecondary Institution,” 1989 and 1995 IPEDS data represent the popu- 
lation of higher education institutions, and 1999 IPEDS data represent the population of institutions eligible to partici- 
pate in the Title IV federal financial aid program. 
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